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Abstract: This paper treats a holomorphic self-mapping / : — > 
n oi a bounded domain in a separable Hilbert space 7i with a 
fixed point p. In case the domain is convex, we prove an infinite- 
dimensional version of the Cartan-Caratheodory-Kaup-Wu Theorem. 
This is basically a rigidity result in the vein of the uniqueness part of 
the classical Schwarz lemma. The main technique, inspired by an old 
idea of H. Cartan, is iteration of the mapping / and its derivative. A 
normality result for holomorphic mappings in the compact-weak-open 
topology, due to Kim and Krantz, is used. 

AMS Subject Classification: Primary 32H02, 46G20 

Introduction 

Perhaps the most important part of the classical Schwarz lemma is the 
uniqueness statement: If f : D —>■ D is a. holomorphic function from the 
unit disc D to itself, /(O) = 0, and |/'(0)| = 1, then / is a rotation. This 
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rigidity statement has had considerable effect in the subject of complex dif- 
ferential geometry. It is the wellspring of many holomorphically invariant 
metrics, and has had a notable influence in the subject of mapping theory. 

The analogous result in higher (finite) dimensions has been explored by 
Caratheodory, Cartan, Kaup, and Wu. See [KRA] and [WU] for a careful 
discussion of the matter. The theorem is that, if a holomorphic mapping 
f : Q ^ Q of a bounded domain Q in C"^ satisfies f{p) = p for some p & Q 
and I dct{Df{p)) \ = 1, then / is a biholomorphic mapping. We remark here 
that the condition on the Jacobian determinant is, in this case, equivalent to 
saying that every eigenvalue of the Jacobian matrix has modulus 1. 

In recent years, the study of holomorphic functions and mappings on a 
Hilbert or Banach space has received much attention. Work of Lempert (see 
for instance [LEM]) has served as a catalyst to this activity. The more re- 
cent work of Kim/Krantz (see [KlKl], [K1K2]) is the more direct genesis 
of the present paper. In this rather general setting, many of the familiar 
tools of finite-dimensional analysis are no longer available. The geometry is 
much more difficult. Yet there is interest in developing these ideas because of 
potential applications to mathematical physics and partial differential equa- 
tions. 

This paper develops a version of the Caratheodory-Cartan-Kaup-Wu the- 
orem on a separable Hilbert space Tl. We begin by formulating and proving 
a result on a convex domain fl C Ti. This is Theorem 1.1. Afterward, in 
Section 3, we present a more refined result (Proposition 3.1) on the ball in a 
separable Hilbert space. 

The authors thank the Banff International Research Station (BIRS) for 
hosting us during the work on this problem, and for providing a stimulat- 
ing working environment. We thank John McCarthy, Peter Rosenthal and 
Warren Wogen for advice and information about analysis on Hilbert spaces. 

1 Statement of the main results 

Let Hhe a. separable, complex Hilbert space, and let B denote its open unit 
ball. Let represent the unit circle in the complex plane C. For a bounded 
linear operator T on H, denote by (j{T) its spectrum, i.e. 

a{T) = {A G C I T - A/ is not invertible} . 

A bounded linear operator T : 7i ^ 7i is said to be triangularizable 



2 



if there exists a basis {ei, 62, . • .} such that T(Cei + . . . + Ce^) C Cei + 
. . . + Cctv for every positive integer A^. In this case, we shall sometimes say 
that T is upper-triangular with respect to the basis {ei, 62, . . .}. Note that 
the basis that renders an operator upper-triangular can always be taken to 
be orthonormal, just because the Gram-Schmidt process preserves the flags 
E]sf = Cei + ■ ■ ■ + Ccat. 

Now we formulate the principal result of this paper: 

Theorem 1.1 Let Q Ti be a bounded convex domain. Fix a point p & Q. 
Let f : Q Q be a holoniorphic mapping such that 

(a) f{p)=p ; 

(b) the differential dfp is triangularizable; 

(c) aidf,) C . 

Then f is a biholomorphic mapping. 

To put the theorem in perspective, notice that in dimension n = 1 the 
hypothesis specializes to just \f'{p)\ = 1. In several (but flnitely many) 
variables, the hypothesis is equivalent to (i) non- degeneracy of the Jacobian 
matrix at p and (ii) all eigenvalues of the Jacobian having modulus 1. In the 
finite-dimensional case, one can always triangularize. In infinite dimensions 
there are geometric conditions (involving the Fredholm index) for triangu- 
larization. 

Even if T is a unitary operator on a Hilbert space Ti (so that certainly 
o"(T) C S^), it does not necessarily follow that T is triangularizable. For 
example, take T to be the forward shift on £^(Z). See [HER] for more on the 
triangular operators. 

Concerning the assumption (b) in Theorem II. H it seems appropriate 
to present an example of a bounded convex domain with an automorphism 
whose derivative at a fixed point is upper-triangular. Consider the map 
A : — *• defined by A{z, w) = {z + bw, —w) for an arbitrary choice for 
& G C \ {0}. Then A is an involution (i.e. A o A = I) with eigenvalues ±1; 
also A is an upper-triangular linear map. Take any bounded domain D in 

containing the origin. Let 

V = DUA{D). 
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Then let Q be the convex hull of in C^. It is obviously a bounded convex 
domain containing the origin. Then A is an automorphism of Q satisfying 
v4(0) = 0. Since dAo = A, the differential dAo is upper-triangular. Further- 
more, if one would sacrifice the convexity of the domain, it is possible also 
to obtain a non-linear example. Let G{z, w) = {z,w + z^) for instance, let 
f = G o Ao and let W = G{Q). Then 1^ is a bounded domain in C^, 
and / is an automorphism of W with /(O) = 0. We see that dfo is clearly 
upper-triangularizable. It is simple to modify this example to give an exam- 
ple in an infinite dimensional Hilbert space; one simply needs to consider a 
map that is equal to A on a two-dimensional subspace and the identity on 
the orthogonal complement of this subspace. 

The referee has raised the question of how large is the class of holomorphic 
mappings f : fl ^ Q satisfying the conditions (a), (b) and (c) of Theorem 
1.1, within the class of such mappings satisfying only (a) and (c). We believe 
that rigidity phenomena for automorphisms of domains in infinite dimensions 
would imply that the answer depends very much on the domain. A related 
question is how large is the class of triangularizable operators on a separable 
Hilbert space H within the class of all bounded linear mappings of H. In this 
connection we mention the Weyl-von Neumann-Berg theorem [DAV, p. 59], 
which asserts that every normal operator is a small compact perturbation 
of a diagonalizable (in particular triangularizable) operator. We thank the 
referee and the editors for their remarks. 



2 Proof of Theorem 1.1 



The proof has several steps, some of which are of independent interest. 
2.1 Basic Facts on the Differential 

Let fli and Q2 be domains in the separable Hilbert space Ti. and let / : fii — > 
fl2 be a holomorphic mapping. The differential of / at a point p E Qi is the 
bounded linear operator on H defined by 

/ N 1. f{p + hv) - f{p) 
djpiv) = lim ; . 

Write B{p;r) = {z E H \ \\z — p\\ < r}. Suppose that Q2 is bounded, say 
^2 ^ -8(0; M). In this situation we have 
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Lemma 2.1 If p E Qi and dist{p, dQi) = d > 0, then 

M 

T 



\\dU\\<—. 



Proof. Choose p > so that B{p; p) C Qi. Let f be a unit vector in H. The 
integral representation 

leads immediately to the Cauchy estimates 

\\dU{v)\\<j, 

and we may let p tend to d. □ 



Lemma 2.2 If \\dfz\\ < A for every z G B{p;r), then for any pair z,w & 
B{p; r) one has 

\\fiz)-fiw)\\<2rA. 



Proof. Write 

/(z)-/H= f ±[f{{l-t)w + tz)]dt 



Iq dt 

and use the chain rule. □ 

Now, in the situation of Theorem 11.11 / is a holomorphic self-map of a 
bounded convex domain in Ti and p is a fixed point. Let us write T = dfp. 

We are assuming that T is triangularizable. Hence it is possible to choose 
a basis ei, 62, . . . such that 

r(Cei + ■ • • + Ccn) C Cei + ■ ■ • + Ce^v 

for every positive integer N. For convenience set 

En = Cci + ■ ■ ■ + Ccn 
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for every positive integer A^. We shall call such Ej^ a flag. The union of 
these flags yields a vector space that is dense in H. 

From here on we assume that the operator T is upper-triangular with 
respect to a fixed ortho normal basis Ci, 62, . . .. 

Notice that cr(T) is contained in the unit circle. Since T is upper- 
triangular, the diagonal entries are contained in its spectrum ct(T), and hence 
are of modulus 1. 

We also note the following consequence of Lemma 12.11 
Corollary 2.3 There exists a constant C such that 

WW < c, 

for every positive integer m. 
2.2 Iteration of T 

In this section T is an upper triangular matrix whose spectrum cr(T) is 
contained in S*^ and whose positive powers are uniformly bounded in norm. 
Denote by \j the (j, j)-th diagonal entry of T. Then = 1, j G N. 

Lemma 2.4 There exists a sequence of natural numbers {m{k)}k such that 
for each fixed j G N, A™*-'^'' — 1 as A; — > 00. 

Proof. The sequence of powers {A^} is bounded, so there is a convergent 
subsequence, say X^^^''^^ q-^ ag _> where |ai| = 1. Similarly the 
sequence of powers {X^^^'''^} is bounded, so there is a subsequence {m{2, k)} 
of {171(1, k)} such that A^*-^''^^ — >• ^2 as ^ cxd, where \a2\ = 1. Continuing 
in this way and using a diagonal sequence argument, we obtain a subse- 
quence {m{k,k)} of the natural numbers and complex numbers aj, j G N, 
of modulus one such that Xj'^^''^^ (^_^. as A; — > 00 for each j G N. Now the 
sequence 

m{k) = m{k + l,k + 1) -m{k,k), keN 
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is easily seen to have the property that 



as k oo, for each j G N. □ 

If A is an infinite square matrix we denote the (i,j)-th entry by Aij, 
1 < ^ oo. Also, we order the positions above the diagonal in such a 
matrix first by column and then by row, i.e. the ordering is (1,2), (1,3), 
(2, 3), (1, 4) . . .. If is a positive integer, we denote the N x N truncation 
of such a matrix hj A^- The N x N identity matrix will be denoted by In. 

Lemma 2.5 There is a sequence of natural numbers {fi{k)}k such that, for 
each N eN, 



Proof. Write T = S + V, where 5* is a diagonal matrix with diagonal entries 
of modulus 1 and V has zeros on and below the main diagonal. Denote the 
diagonal entries of 5 by Aj, j = 1, 2, . . . . 

By Lemma [2.41 there exists a sequence of natural numbers {m(/c)} such 
that A™^*^^ 1 ag ^ for each fixed j. 

The entries {(r™('^))i,2}fe are bounded, so there is a subsequence {/i(fc; 1, 2)} 
of {m{k)} such that {iT''^'''^'^^)i,2}k converges. By similar reasoning, a fur- 
ther subsequence {fi{k; 1, 3)} has the property that {(T'^'''^'^''^^)i,3}fc converges, 
and a further subsequence of that one, denoted by {/i(fc; 2, 3}, has the prop- 
erty that {(r^'('='2'^))2,3}fc converges. Continuing in this way and extracting 
a diagonal subsequence yields a subsequence {f^{k)} of {m{k)} such that 
{{T^^''^))ij}k converges for all (i, j), 1 < i < j < oo. 

Thus there is an infinite square matrix W, whose entries on and below 
the main diagonal are zero, such that for each G N we have (T/v)^*-*^'' — >■ 
In + (For fixed A^ the convergence may be taken to be in norm, but the 
norm convergence is not uniform in A^.) 

Now choose the smallest value of A^ > 2 with the property that Wn 7^ 0. 
Then at least one of the entries in the last column of Wn is nonzero, and all 
entries in the other columns of Wn are zero. If £ is a positive integer, then 

((T^)Mfc))^ = (TnTW' - {In + WnY, k ^ 00, 
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and the entries in the last column of the matrix on the right are given by i 
times the corresponding entries in (J^v + W^) (except for a 1 in the (A^, A^)- 
position). 

But this is a contradiction to the power boundedness of T for sufficiently 
large I (see Corollary 12. 3p . We conclude that no such exists, i.e. W = 
Therefore the sequence {/^(A;)} has the property that (T^)^^''^ — > /^v as A; — *• 
oo for each fixed A^. □ 



2.3 Iteration of / 

Next, consider the iteration given by = /, Z™' = / o f"^~^ for each integer 
m > 1. 

We need the following two fundamental results. There is in fact a Banach 
space version of the theorem of Kim and Krantz [KIK2]; we indicate a proof 
here for the Hilbert space case. 

Theorem 2.6 (Kim/Krantz [KIK2]) Let Qi,Q2 be domains in a sepa- 
rable Hilbert space Ti, and let VL2 be bounded. Then every sequence : 
^ I n = 1, 2, . . .} of holoniorphic mappings admits a subsequence 
{hn{k)}k that converges to a holomorphic mapping h from Qi into the closed 
convex hull of Q2, in the compact-weak-open topology (i.e., the compact- 
open topology in which the strong topology is used on the domain space and 
the weak topology is used on the target space). 

Proof. Let ( ■ , ■ ) denote the Hilbert space inner product (linear in the first 
variable, conjugate-linear in the second). One needs to show that for every 
sequence {h^ : Qi ^ Q2 | ^ = 1, 2, . . .} of holomorphic mappings, there is a 
subsequence {/i„(fc)}fc and a holomorphic mapping h : Qi ^ H such that, for 
all g in the unit ball of 7i, {hn(k),g) {h,g), uniformly on compact subsets, 
as — s> 00. If g is such that 3?(w, (?) < 1 for all w G ^2, then it is clear that 
^{h,g) < 1, i.e. the image of h must be contained in the closed convex hull 

of 

Let {zn}nm be a dense sequence in fli. We are going to do the usual diag- 
onal sequence construction. The sequence {hn} has a subsequence {hn{i,k)}k 
such that /i„{i,fc)(zi) converges weakly to an element h{zi) as 00. This 
just uses the boundedness of fl2- 

Now choose a subsequence of {n{l,k)}k, denoted by {n{2,k)}k, so that 
hn{2,k){z2) converges weakly to an element h{z2) as k cxd. Continue and 
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then choose the diagonal sequence {hn(k)}k = {hn{k,k)}k generated by this 
process. 

Since Q2 is bounded, as we did earher in the proof of Lemma 2.1, we let 
M be a positive constant such that Q2 C. -8(0; M). 

Assume that K is a. compact subset of Qi and let e > 0. Denote by 
D = dist {K, dQi) and let 6 = min{y, ^^g}- Cover K with a finite number of 
balls B{xi; 6), . . . , B{xm', S) such that B{xi] 6)nK 7^ for any £ = 1, 2, . . . , m, 
where each xe belongs to the dense sequence {zn}nm- Note that for z e 
B{x£]5) one has dist(2;, > Z)/3. By Lemma [2?T] we have ||(i/i„|2|| < ^ 
for such z. This holds for every n. By Lemma 12.21 and the choice of 5, we 
have 

11, / N , / M, 6M5 e . . 

\\hn{z) - K{W)\\ < ^ < - (2) 

for all z, w G B{xi,5). For any g in the unit ball of if, choose J = J{g) so 
that, for j,k > J, we have 

\{hn{j){Xi) - hn{k){Xi),g) \ < I 

for 1 < £ < m. 

Now for any choice of z G -ft' we have the existence of some £ with z G 
B{xe, 6). Then for j,k > J we have 

I (hnij) (z) - K(k) {z),g)\ < I {z) - K(j){xi), g) \ 

+ \{K{j){xt) - hn(k)ixi),g)\ 
+ \{hn{k){xe) - hn(k){z),g) \ . 

Each of the terms on the right hand side is less than e/3. For the first and 
third terms this follows from ([2]), and for the second term it follows from the 
choice of J. 

This shows that the sequence hn[k){.z) converges weakly to the "assign- 
ment" h{z) uniformly on compacta. It remains only to show that the assign- 
ment is an analytic mapping on Vti. But given a fixed £ ^1 and a unit 
vector t> G 7i, we can find a > such that the closed disc 

S = {z, + Cv\\C\<a} 

is contained in fii, and hence the analytic functions {hn{k){zQ + C'^),g) con- 
verge uniformly to {h{zQ + (v) , g) . The mapping ( 1-^ h{zQ + C,v) from the disc 



9 



of radius a in C into 7i is therefore holomorphic. This says precisely that h is 
Gateaux holomorphic [HIP], [MUJ]. Since a bounded Gateaux holomorphic 
mapping is holomorphic, we are done. □ 

Remark 2.7 By the Cauchy estimates^ it follows from Theorem \2.6\ that 
the derivative dhn{k)\z{v) converges to dhz{v) weakly, uniformly on compact 
subsets of Qi X H (i.e., z E Qi and v eH). 

To see this, let L be a compact subset of Qi x Ti. Then for all {z, v) G L, 
we have dist(z, dfli) > a > and ||u|| < b, for some positive constants a and 
b. It is elementary to see that there exists r > such that 

K = {z + Cv\{z,v)eL,\C\<r} 

is a compact subset of Qi. Now the relation ([1]) gives 

dhn{k)\z[v) - dhz[v) = — 7^ "C , 

for all {z, v) G L. Hence for any linear functional r on Ti, 

r o dhn{k)\z{v) - Todhz{v) 

_ J_ f ^ ° hn(k)iz + Cv) - TO h{z + C^^) 

The assertion follows easily from this in view of the compactness of K. 



Theorem 2.8 (H. Cartan) Let VL he a bounded domain in Ti and let p G 

Q. Let f : Q ^ Q be a holomorphic mapping with f{p) = p and dfp = I. 
Then f coincides with the identity mapping of Q. 

See [FRV], [KRA] for the proof of Cartan's theorem. 

Now apply Theorem 12. 61 to the sequence {/'^^^-'}, where / is the mapping 
in Theorem 1.1 and {fi{k)} is the sequence constructed in Lemma [2.51 We 
obtain a subsequence {f'^^''^ that converges to some / in the compact- weak- 
op en-topology. The sequence of derivatives at p is {T'^^''^. The discussion 
of the preceding section shows that 

hm (r^v)"^') = In 

fc— >oo 
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for every positive integer N. 
Thus 

dfp\EN = for every N =1,2,... . 

Note that (J-Eat is dense in H. Since dfp is bounded and dfp\^ = In for 

N 

all N, it follows that dfp = I. 

Finally, the fact that f{p) = p together with the convexity of Q implies 
that /(fi) C Q. Now Cartan's theorem (Theorem 12.81) implies that / = id. 

2.4 Proof of Theorem 11.11 

It is time to complete the proof of Theorem II. 1[ From the last part of the 
preceding subsection, we have 

hm f{r^'^~\z)) = z = hm r^'^-\f{z)) (3) 

fc— »oo fe— >oo 

in the compact- weak-open topology on fl. 

By Theorem 12.61 choose a subsequence {fe} of {Z*^^^^"^} that converges 
to a holomorphic mapping h : Q ^ Q in the compact-weak-open topology. 
(Recall that Q is convex and h{p) = p). 

The second identity in Q implies that 

hof = id. (4) 

We see therefore that the holomorphic mapping h is a left inverse of /, and 
that f o h is a holomorphic mapping from Q into itself. 

On the other hand, one cannot immediately deduce from the first identity 
in ([3]) that foh = id, because it is only known at this point that fe converges 
to h weakly. (With respect to the weak topology on the source-domain and 
the strong topology on the target- domain, holomorphic mappings need not 
be continuous.) So it is necessary to show that f o h = id. 

Now (j4]) implies that 

dhp o dfp = I. 
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Since dfp is invertible, we see that dhp is also the right inverse of dfp. This 
imphes that 

d{f o h)p = dfp o dhp = I. 

Applying Cartan's Theorem (Theorem 12.81) again to f o h : Q Q, we see 
that 

f o h = id. 

Therefore / is a biholomorphic mapping of Q onto itself. This completes the 
proof. □ 



3 Closing Remarks 

For holomorphic functions (i.e. C-valued functions) on a domain in a separa- 
ble Banach space, there is a normality result for the compact-open topology, 
similar to the finite-dimensional case [HUY], [KIK2], [MUJ]. For holomor- 
phic mappings there is no such result unless one makes further restrictions 
[HUY]. However, it is possible to obtain interesting theorems about holo- 
morphic mappings using normality with respect to the compact-weak-open 
topology. 

The assumption that the differential be triangularizable at the fixed point 
is not necessary for the conclusion of Theorem 11.11 to be valid. In the case 
of the unit ball B of the Hilbert space H, a unitary map conjugated by a 
Mobius transformation is a holomorphic automorphism, but in general the 
differential at the fixed point is not triangularizable. This phenomenon re- 
flects the difficulty in the case of infinite dimensional holomorphy caused by 
the excessive size of the isotropy group in such cases as the ball (in finite di- 
mensions, large isotropy group characterizes the ball — see [GRK]). However, 
the ball case has a reasonable formulation as follows. 

Proposition 3.1 Let f : B ^ B be a holomorphic mapping, let p E B, and 
let Mp be a Mobius transformation of the ball sending p to the origin. If f 
satisfies: 

(1) f{p)=P, 

(2) U od[Mp\ |pO(i/pO(i[M~^] |o is triangularizable, for some unitary transform 
U, and 

(3) cr(f/ o (i[Mp]|p o dfp o (i[M~^] |o) lies in the unit circle in C, 
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then f is an automorphism of B. 



The arguments given in this article surely yield a proof of Proposition 
3.1. However, one can simplify the argument, thanks to the fact that the 
domain in consideration is the unit ball. Indeed, from Schwarz's lemma, up- 
per triangularity and the spectrum condition, one obtains that the operator 
V = U o d[Mp\\p o dfp o (i[M~^]|o has norm 1. It is known [DIN] that such a 
linear transformation V is in fact unitary. Thus Cartan's Theorem applied 
to oU o Mp o / o implies that this map is the identity map. Hence 
/ is a holomorphic automorphism of B. The authors would like to thank 
Warren Wogen for pointing out this line of reasoning. 

The convexity assumption on Q was necessary due to the use of weak 
convergence in several places. Whether one can remove this additional as- 
sumption should be an interesting problem to explore in future work. It 
would also be of interest to know whether there is a result of Schwarz-Pick 
type in our infinite-dimensional context. 
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